+41-1-9187040 TSU) AG 8126 ZUMIKON 



415 S02 23.05.01 



Method of generating an electrical, output signal and 
acoustical/electrical conversion system 

The present invention is directed, generically, on the art 
of beamforming. Although it is most suited to be applied 
for hearing apparatus, and thereby especially hearing aid 
apparatus, it may be applied to all categories of 
beamforming with respect to acoustical/electrical signal 
conversion. We understand under beamforming of acoustical 
to electrical conversion tailoring the dependency of the 
transfer gain of an acoustical input signal to an 
electrical output signal from the spatial angle at which 
the acoustical signal impinges on acoustical/electrical 
converters, and, in context with the present invention, on 
at least two such acoustical to electrical converters. 

In some types of such beamforming as especially based on 
the so-called "delay and sura" approach, the dependency of 
the output signal from the spatial angle of the impinging 
acoustical signal is additionally dependent on frequency of 
the acoustical signal. 

Although we are going to explain this phenomenon on the 
basis of the so-called "delay and sum" beamformer, which is 
most suited for implementing the present invention, other 
types of beamformers may show up frequency -dependent 
beamforming as well and thus might be suited for 
implementing the present invention too. 

In fig. 1 there is schematically shown, by means of a 
signal flow/ functional block diagram, a so-called "delay 
and sum" beamformer. There is provided an acoustical 
electrical converter arrangement 1 with at least two 
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acoustical/electrical converters, as of microphones Mi and 
M 2 . These at least two acoustical/electrical converters Mi 
and M £ are arranged with a predetermined mutual distance p. 
Considering an acoustical signal A impinging on the two 
5 acoustical/electrical converters M x , M 2 and generated from 
an acoustical source considerable further away than given 
by the distance p, there occurs a difference d of path 
length for the acoustical signal A with respect to M a and 
M 2 « Dependent on the spatial angle d f at which the 
10 acoustical signal A impinges on the converters, d results 
to 

d « p ■ cos 8 

This accords to a phase shift A<pp or to a time-delay x p 
which may be expressed as 

15 t = — = — cos 0, 

c c 

Therein, c is the velocity of sound in surrounding air. The 
output signals Si and S 2 have thus a mutual phasing A<pp 
according to the impinging angle 0. The two signals S x and 
S 2 are superimposed by addition as shown by the adding unit 

20 5 of fig, 1 after of one of the two signals having been 
delayed by x 1 as shown at the unit 7. By appropriate 
selection of t* there is established, for which spatial 
angle 9 the gain between acoustical input A and result of 
the addition, S aj will be maximum and, respectively, 

25 minimum. If the two converters Mi and M 2 are e*g- 
omnidirectional this will result in a first order 
beamforming characteristic at the output S a of the adding 
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unit 5 with respect to acoustical input signal A. Such a 
characteristic is qualitatively shown in fig. 2 for one 
frequency f of an acoustical signal A- With respect to 
frequency behavior of this characteristic attention is 
5 drawn to fig- 3. Here the frequency dependency of the gain, 
the so-called "roll-off" characteristic, is shown for a 
first order beamformer realized e.g. by the embodiment of 
fig. 1 with p = 1-9 era, as shown at (a) and for p « 1.2 cm 
as shown at (b) . The characteristic (c) will be discussed 
10 later in connection with the present invention. 

In dependency of the order of beamf orming the beam 
characteristic has a significant high-pass behavior. At a 
first order cardioid beam gain drops with 20 dB /Dk, for a 
second order beam characteristic with 40 dB/Dk, etc. An 

15 important drawback of such a transfer gain frequency 

dependency is the significant reduction of the signal to 
noise ratio for lower frequency signals. This has a 
negative impact on the quality of sound conversion, 
especially in the "target direction", that is in direction 

20 9, wherefrom acoustical signal shall be amplified with 
maximum gain. 

It is an object of the present invention to provide for a 
method and a respective system, whereat frequency behavior 
of the beamf orming gain characteristic may be adjusted and 
2 5 thereby especially remedied at least over a desired 

frequency band. To do so, there is proposed a method of 
generating an electrical output signal as a function of 
acoustical input signals impinging on at least two 
acoustical/electrical converters, the gain between the 
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acoustical input signal and the electrical output signal 
being dependent cn the spatial angle with which the 
acoustical input signals impinge on the at least two 
converters. Further, the gain is dependent on frequency of 
5 the acoustical input signals- Thereby, first and second 
signals respectively depending on the acoustical input 
signals are co-processed to result in a third signal which 
is dependent on both, namely the first and the second 
signal, 

10 When we refer to "co-processing 11 signals, we thereby mean 
performing an operation on both signals resulting in a 
signal which is dependent on both input signals* Thus, 
addition, multiplication, division etc. are considered to 
be co-processing operations, whereat time-delaying a signal 

15 or phase- shifting a signal or amplifying are considered 
non -co -processing operations. 

Further and in view of the above mentioned object there is 
established a desired frequency dependency of the gain by 
installing a mismatch of gains between the acoustical input 
2 0 signal and the first signal and between the acoustical 

input signal and the second signal, both first and second 
signal being then co-processes* 

Thereby, the present invention departs from the following 
recognition: 

25 We have in context with fig* 3 shown the frequency roll -off 
of a beamformer, as especially addressed by the present 
invention having a high-pass characteristic. This is 
nevertheless only then valid, if the gains between the 
acoustical input signal and the first signal applied to co- 
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processing as of adding at unit 5 of fig. 1, and the gain 
between the acoustical input signal and the second signal 
as applied to the second input of co-processing are 
perfectly matched. If these gains are mismatched, which is 
5 customarily to be avoided by all means , there results a 

roll-off behavior as shown in fig.. 2 at (c) - The frequency 
characteristic transits for mismatched gains at a lower 
edge frequency f? from high-pass behavior to an all -pass or 
proportional behavior. 

10 In contrary to previous approaches of beamforming 

realization, where all measures possible were taken to 
avoid such mismatch, the present invention advantageously 
exploits such mismatch. 

Although in one embodiment of the present invention such 
is mismatch may be installed in a fixed manner, as e.g, by 
appropriately selecting mismatched converters, in a 
preferred embodiment of the inventive method such mismatch 
is provided adjustable and especially automatically 
adjusted. 

20 In a most preferred embodiment of realizing the inventive 
method, mismatch is established in dependency of the 
spatial impinging angle of the acoustical input signal . 
Thus, different extents of mismatch are selected for 
different spatial angles or ranges of spatial angle. 

25 Thereby, in a further preferred embodiment, a predetermined 
mismatch is established whenever the spatial angle of the 
acoustical input signal is within a predetermined range, if 
it is not, a different mismatch up to no mismatch is 
established or maintained. 
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By further establishing the mismatch in dependency of the 
frequency of the acoustical input signal it becomes 
possible to tailor the frequency behavior of the gain or 
beam* 

5 as was mentioned above, in one preferred mode of realizing 
the inventive method a "delay and sum* -type beamformer is 
improved. Thus, in a preferred embodiment the inventive 
method further proposes to time-delay one of the first and 
of the second signals before co-processing is performed, 
10 Thereby, in a further preferred mode such time -delaying is 
performed in a dependency of frequency of the acoustical 
input signal. 

In a most preferred variant of performing the inventive 
method time -domain to frequency- domain conversion is 

15 performed at the first and at second electrical signals, 
which are dependent on the impinging acoustical signal, 
before co-processing is performed. As will be seen from the 
following explanations, signal processing in frequency- 
domain is most advantageous* Thereby, for subsequent time 

2 0 frames according to the conversion clock and for at least a 
part of the frequencies of the conversion, of the bins, 
there is generated a complex mismatch control signal, i*e. 
with real and imaginary components . By adjusting mutual 
phasing of the first and second signals and simultaneously 

25 performing said mismatch by the complex mismatch control 
signal, on one hand time -delaying is realized frequency* 
specifically, and mismatch is realized frequency- 
selectively too- After such complex mismatch control with a 
complex value the mismatched signals may just be additively 
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co-processed to realize an inventively improved "delay and 
sum " beamf or me r . 

In a further improved mode of operation of the just 
mentioned mismatching by means of a complex mismatch 
5 control signal, there is proposed to calculate the actual 
mismatch control signal by means of an approximation 
algorithm. Thereby, the actual mismatch control signal for 
instantaneous time frame of time-domain to frequency- domain 
conversion is evaluated on the basis of such mismatch 
10 control signal as was derived for a previous time frame, 
preferably the next previous time frame. Optimal results 
are achieved with minimal resources of computing power by 
applying a "least means square" algorithm. 
The above mentioned. object is further resolved with an 
15 acoustical/electrical conversion system of the present 
invention, which comprises at least two acoustical to 
electrical converters respectively with first and second 
outputs. These outputs are operationally connected to 
inputs of a co-processing unit which generates an output 
20 signal dependent on signals on both, said first and said 
second outputs. The output of the co-processing unit is 
operationally connected to an output of the system, whereat 
a signal is generated, which is dependent on an acoustical 
signal impinging on the at least two converters and from 
spatial angle with which the acoustical signal impinges on 
these converters. Further, this single dependency is 
dependent on frequency of the acoustical signals. Thereby 
the gains between acoustical input to said converters and 
the inputs to the co-processing unit are wantedly 



25 
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mismatched to provide for a desired dependency of the 
signal generated at the system output on the frequency of 
the acoustical input signals* 

Preferred embodiments of the system according to the 
5 present invention, whereat the inventive method is 
realized, are specified in claims 14 to 24. 

The invention shall now be exemplified by means of the 
following detailed description and With the help of 
figures. These show: 

10 Figs, l to 3 have already been explained 

Pig. 4 in a signal flow/ functional block simplified 
representation, the generic principle of the 
inventive method and system; 

Fig. S in a representation in aneilogy to that of fig. 4, a 
15 first preferred realisation form of the inventive 

method and system; 

Fig* € in a representation form according to that of the 



Fig. 7 again in a representation in analogy to that of the 
figs. 4 to 6, a preferred realization form of the 



20 



figs. 4 and 5, a further improvement of the system 
and method by applying complex mismatch control and 
thereby simultaneously realizing delaying of a 
delay and sum beamformer and controlled 
mismatching 



25 



embodiment according to fig. 6, 



Fig, 



8 



still in the same representation, a today's 
preferred mode of realization of the embodiment 
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according to fig, 7, thereby using approximation 
for mismatch control ; 

Fig. 9 the gain characteristic with respect to spatial 
angle and frequency of a prior art delay and sum 
5 beamf ormer ; 

Fig. 10 the beamf ormer leading to the gain characteristic 
of fig. 9 , inventively improved, thereby selecting 
a mismatch spatial angle range of ± 90° , and 

Fig. 11a characteristic according to that of fig- 10 for 
10 further reduced range of spatial angles, for which 

the inventively applied mismatch is active. 

Fig. 4 shows in a most schematic and simplified manner a 
signal flow/ functional block diagram of a system according 
to the present invention, thereby operating according to 
15 the inventive method. From the array or arrangement 1 of at 
least two acoustical/electrical converters Mi and M 2 and at 
respective outputs Ai and A 2 , two electrical signals Si and 
3 2 are generated ♦ 

In processing unit 12 signals S l0i and Si 02 , respectively 
20 applied to inputs E i2 i and Ei 22 of unit 12, are co-processed, 
resulting in a signal dependent on both input signals Stoi 
and Sjo2- These signals input to unit 12 respectively depend 
on the signals S x and S 2 and are generated at outputs A i0 i 
and A102 of a mismatch unit 10 with inputs E x and E a , to 
2 5 which the signals and S 2 are fed. 

in the mismatch unit 10 the gains between the acoustical 
input signal A to respective ones of the signals Sioi and 
S X o2 are set. Thereby, as schematically shown by adjusting 



P200680 



+41-1-9187040 TSUI PG 8126 ZUMIKON 



416 Sll 



23.05.01 07:57 



- 10 - 

elements 1Q X and 10 2 an appropriate desired mismatch of the 
gains in the two channels from U x to one input of unit 12 
and from M 2 to the other input thereof is established. Such 
a mismatch as schematically shown in fig. 4 may be 
5 installed by appropriately selecting the converters Mi and 
M 2 to be mismatched themselves with respect to their 
conversion transfer function, but is advantageously 
provided as shown in fig- 4 in the respective electrical 
signal paths. As inventively a mismatch with respect to the 

10 two channels is to be installed it is clear that 

mismatching the gain in only one of the channels is 
sufficient, although the gain in both channels may be 
respectively adjusted or selected to result in the desired 
mismatch by inversely varying the respective channel's 

15 gains. 

Still simplified and with a signal flow/ functional block 
representation, fig. 5 shows a preferred realization form 
of the principal according to the present invention and as 
explained with the help of fig. 4. Elements which have 
20 already been described in context with figures 1 to 4 are 
referred to with the same reference numbers. 

According to the embodiment of fig* 5 the mismatch unit 10 
most generically shown in fig. 4 is realized as a mismatch 
unit 10' , interconnected as was explained in the respective 
25 channels from the acoustical input of the converters Mi, Ms 
to the respective inputs 3S XZ1 , of the processing unit 

12 , where co-processing occurs. By applying a control 
signal s C io to the control input C xo mismatch of these two 
channels is adjusted. The control input Ci 0 is 
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operationally connected to the output A i4 of a mismatch- 
controlling unit 14* Inputs E^i and E142 to the mismatch- 
controlling unit 14 are operationally connected to the 
respective outputs Ai and A 2 of the converter arrangement 
5 !♦ Thus, the respective signals S i2 and s n input to unit 14 
are in most generic terms dependent on the output signals 
Si and S z . As will be seen later on such an input signal as 
dependent on Si and/or S 2 may also be derived from the 
output signal S a (Sioi, S 10 2> at the output of processing unit 
10 12. 

Due to such input signals to the mismatch-controlling unit 
14, information about spatial angle 8 with which the 
acoustical signal A impinges on converter arrangement 1 is 
present, namely e*g. by the information about the mutual 

15 phasing A<p p of the signals Si, S 2 , Also when, as shown in 

dashed lines, one first input of unit 14 receives a signal 
dependent on only one of the signals S x and S 2 as well as 
as a second input signal, namely a signal dependent on the 
output signal S a of processing unit 12, which per se 

20 depends on the second signal Si or S 2 respectively too, 

spatial angle information is present by these two signals 
Si or S 2 and S a , 

in mismatch-controlling unit 14 the control signal s C io is 
generated in dependency of the spatial angle 0 with which 
25 the acoustical signal A impinges on the arrangement l. 
Although such dependency may be established in a large 
variety of different ways to establish, at mismatch unit 
10 1 for selected spatial angles 9 desired mismatching of 
the channel gains in a most preferred embodiment the 
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control signal S C io establishes mismatch, whenever the 
spatial angle 6 of the acoustical signal A is within a 
predetermined range 9 R of spatial single. 

Thus, according to the embodiment of fig* 5 mismatch is 
5 established in dependency of the spatial angle 8 and 

especially preferred only if the spatial angle 9 of the 
acoustical input signal is within a predetermined range, 
and thereby especially in a predetermined range 
symmetrically with respect to that impinging angle, which 
10 shall have, according to fig, 2 at 9 = 0, maximum 
ampl i f icat ion . 

Looking back on fig, 3, for a "delay and sum" -type 
beamformer, applying the teaching of fig. 5 results in the 
high-pass characteristic being remedied by mismatch within 

15 the range 6 R of spatial angle with high gain, whereat for 
spatial angles aside the desired range 9* and according to 
side parts of the beam of fig. 2 smd as denoted there by 
the areas F, high-pass characteristic is maintained* This 
leads to an even improved beaittf orming effect of the "delay 

2 0 and sum" beamformer. 

Most schematically there is shown in fig. 2, for the 
spatial angle 6=0 and for spatial angles aside the 
predetermined range 6 R# an example of roll-off /spatial 
angle distribution, in dotted lines and denoted with «ro». 

25 Departing from the realization form according to fig- 5, 
fig. 6 shows a further improvement. Thereby, the mismatch 
unit 10 1 performs for adjusting and mismatching the complex 
gains of the channels from acoustical input signal A to the 
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respective inputs Em and E 12 2 of the co-processing unit 12, 
Accordingly the mismatch -cent rolling unit 14 1 generates a 
complex controlling signal 5cio which controls the complex 
gain mismatch, as exemplified in the block of unit 10' by 
5 adjusting complex impedance elements Zio* Zxoa . By 

applying a complex gain mismatch and as is evident to the 
skilled artisan f the magnitude of the respective gains of 
the channels is mismatched as well as the mutual phasing of 
the two channels being adjusted, as schematically 
10 represented in fig. 6 by Acp p as input phasing to unit 10 1 
and controlled output phasing Aq>c» 

As adjusting mutual phasing is equivalent to adjusting a 
mutual time-delay as of t 1 in the delay and sum beamformer 
of fig. 1, it just remains in co-processing unit 12 to 
15 perform summing to realize a delay and sum beamformer, 

which is nevertheless improved with respect to frequency 
roll-off. 

The embodiment of fig, 6, whereat a complex mismatch 
control is performed and which is highly advantageous, is 
20 clearly best realized in f requency-domain. 

Accordingly, in the embodiment of fig, 7 as a most 
preferred embodiment the result of the 

acoustical/electrical conversion in the respective channels 
is first analogue to digital converted at respective 
25 converters XS X and 16 2 . Subsequently the respective digital 
signals Si# and S 2 # are subjected to time-domain to 
frequency- domain conversion at respective converters 181 
and I8 a . The mismatch controlling unit 14' provides for 
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each time frame of the time-domain to frequency- domain 
conversion and for at least a part of the frequencies or 
bins a complex mismatch control signal Seio fed to the 
mismatch unit 10 ! , whereat element by element 
5 multiplication is performed of the complex vectorial signal 
2^ with the complex mismatch control signal S C io , thus 
multiplying each element of §1, e.g. S 2 i, S 2S with the 
respective element of Scio/ e-g* Scioi# Scio2* leading to the 
result S i0 2 with elements S21 ' Scion , S22 1 Seioa* 

10 The today's most preferred realization form of the 

inventive method and system is shown in fig- 8. It departs 
from the embodiment of fig. 7. Only parts and functions g 
which have not been described yet will be addressed- The 
mismatch-controlling unit 14 1 1 is fed with one of the time 

15 to frequency domain converted output signals Si or S 2 # aa 
shown in fig. 8 with S 3 as a complex value signal. The 
second input according to E i41 e.g. of fig. 5 is 
operationally connected with the output A i2 of the co- 
processing unit 12. The mismatch -control ling unit 14 ' 1 

20 calculates from the output signal of the system prevailing 
for a previous time frame of time to frequency conversion 
as well as from an actual signal as of of an actual 
time frame, with an approximation algorithm, most 
preferably with a "least means square" algorithm, the 

25 complex valued mismatch -control ling signal S' G1C , which is 
element by element multiplied in the multiplication unit 
10' acting as mismatch unit* As was explained summation for 
the inventive "delay and sum" beamformer as of fig. 8 is 
performed in co-processing unit 12, the output signal 

30 thereof sZ being backtrans formed to time-domain in unit 20. 
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Pig. 9 shows over the axis of spatial angle ft and frequency 
f the gain magnitude as measured at a prior art "delay and 
sum" foeamf ormer of first order with cardioid characteristic 
as of fig, 2 and with zero gain at an angle ft = ISO 0 . 

S Fig, 10 shows in the same representation as of fig. 9 the 
gain characteristic between acoustical input and system 
output of a beamformer construed as was explained with the 
help of fig, 8, thereby selecting the preselected range Or 
to be at - 90° < 9 < + 90^. 

10 Further reducing of the preselected range for spatial angle 
Or leads to the gain behavior as shown in fig. 11. 

From comparison of the figs. 9 to 11 the significant 
improvements of the , transfer characteristic of a conversion 
system and the method according to the present invention 
15 become apparent to the skilled artisan. 
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